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■ Abstract 

(n: 

The Bernoulli sieve is the infinite "balls-in-boxes" occupancy scheme with random frequencies 
pLf Pk = Wi ■ ■ ■ Wk^i{l — Wk), where {Wk)k£T>i are independent copies of a random variable 

I W taking values in (0, 1). Assuming that the number of balls equals n, let L„ denote the 

number of empty boxes within the occupancy range. In the paper we investigate convergence 
in distribution of L„ in the two cases which remained open after the previous studies. In 
particular, provided that E|logM^| — E| log(l — W)\ = oo and that the law of W assigns 
comparable masses to the neighborhoods of and 1, it is shown that L„ weakly converges to 
a geometric law. This result is derived as a corollary to a more general assertion concerning 
the number of zero decrements of nonincreasing Markov chains. In the case that E| log W\ < 
f~i ■ oo and E| log(l — W)\ = oo we derive several further possible modes of convergence in 

\ distribution of L„. It turns out that the class of possible limiting laws for L„, properly 

normalized and centered, includes normal laws and spectrally negative stable laws with finite 
mean. While investigating the second problem we develop some general results concerning 
the weak convergence of renewal shot-noise processes. This allows us to answer a question 
<N ■ asked in M 

> 



Keywords: Bernoulli sieve, continuous mapping theorem, convergence in distribution, depois- 
sonization, infinite occupancy scheme, renewal shot-noise process 

1 Introduction 

Let (Tfe)jtgi!^Q be a multiplicative random walk defined by 

k 

><: To:=l, n:=flWi, keN, 

a : i=i 

where (Wk)k£N are independent copies of a random variable W taking values in (0,1). Let 
(?7fc)fceN independent random variables with the uniform [0, 1] law which are independent 
of the multiplicative random walk. The Bernoulli sieve is a random occupancy scheme in 
which 'balls' C/^'s are allocated over infinitely many 'boxes' (Tfc,Tfc_i], k €N. The scheme was 
introduced in [8j. Further investigations were made in |10 1 111 ! [T2 t 113 1 H^j- Since a particular 
ball falls in box (Tfc,Tfc_i] with probability 

Pk := Tk-i -Tk = W1W2 ■ ■ ■ Wk-i{l - Wk), 
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the Bernoulli sieve is also the classical infinite occupancy scheme [9l |T8] with random frequencies 
(-Pfc)fceN) where (abstract) balls are allocated over an infinite array of (abstract) boxes 1,2, .. . 
independently conditionally given (Pk) with probability Pj of hitting box j. Alternatively the 
Bernoulli sieve can be thought of as a randomized variant of the leader election procedure which 
appears if the law of W is degenerate at some x £ (0, 1) (this may be especially appropriate for 
the reader familiar with the analysis of algorithms). 
We will use the following notation for the moments 

fi:=E\logW\ and u := E\log{l - W)\ 

which may be finite or infinite. Assuming that the number of balls equals n denote by Kn 
the number of occupied boxes, M„ the index of the last occupied box, and -L„ := M„ — Kn 
the number of empty boxes within the occupancy range. The present paper is a contribution 
towards understanding the weak convergence of L„. With the account of the results obtained 
here and in some previous works on the subject we can now draw an almost complete picture 
(Remark 11.41 which discusses two cases where the weak convergence of L„ remains unsettled 
reveals what is hidden behind the word 'almost'). Depending on the behavior of the law of W 
near the endpoints and 1 the number of empty boxes can exhibit quite a wide range of different 
asymptotics. 

Case < oo and u < oo: L n converges in distribution and in mean to some L with proper and 
nondegenerate law (Theorem 2.2(a) in and Theorem 3.3 in [H]). Furthermore there is also 
convergence of all moments (Theorem 20(b) in |20j). 

Case /x = oo and z/ < oo: L„ converges to zero in probability (Theorem 2.2(a) in |13j). 
Case /i < oo and v = oo: There are several possible modes of the weak convergence of Ln, 
properly normalized and centered (see Theorem 11.21 of the present paper). 
Case /x = oo and i/ = oo: The asymptotics of L„ is determined by the behavior of the ratio 
¥{W < x}/P{l — W < x}, as X I 0. When the law of W assigns much more mass to the 
neighborhood of 1 than to that of equivalently the ratio goes to 0, L„ becomes asymptoti- 
cally large. In this situation the weak convergence result for L„, properly normalized without 
centering, was obtained in |17j under a condition of regular variation. If the roles of and 1 
are interchanged L„ converges to zero in probability (this follows from Theorem 7.1(i) in [12] 
and Markov inequality). When the tails are comparable L„ weakly converges to a geometric 
distribution (see Theorem 11.11 of the present paper). 

Also it was known that whenever L„ -4 L, where L is a random variable with a proper and 
nondegenerate probability law, the law of L is mixed Poisson (Proposition 1.2 in [l7j), and that 

Ln has the geometric distribution with parameter 1/2 when W = 1 — W (Proposition 7.1 in 

my 

Throughout the paper geom(a) denotes a random variable which has the geometric distri- 
bution (starting at zero) with success probability a, i.e., 

P{geom(a) = m} = a(l - a)™, m G No, 

and M{0, 1) denotes a random variable which has the standard normal distribution. 

We are ready to state our first result which treats the case of 'comparable tails' when /i = 
u = oo. 

Theorem 1.1. Suppose // = oo and 
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Then 

Ln 4> L = geom((c + l)""*^), n — ;> oo. (2) 
In particular, relation ([2]) holds whenever the tails are comparable, i.e., 

y m-W< X} 

iis nw<x] 

The situation when /i < oo and i/ = oo is covered by Theorem 11.21 which is our second result. 
Theorem 1.2. Suppose v = oo, and the law of \ logW\ is non-lattice. Set 



^ J[l,n] Z 

where := Ee-^^^"^), s > 0. 

(a) Ifo-^ = Var (log W) < oo then, with On '■= VK., ihe limiting distribution of is standard 
normal. 

(b) Assume that a'^ = oo and 

/ y¥{|logVF| G dy} ~ I{x), x oo, (4) 

J[0,x] 

for some £ slowly varying at oo. Letc{x) be any positive function satisfying lim xi{c{x)) / (? {x) = 

1 which implies that c(x) ~ x^^'^l*{x), x ^ oo, for some i* slowly varying at oo. 
(bl) // 

limF{\log{l-W)\> x}{t{x)f = (5) 



then, with = the limiting distribution of ^"^ ^" is standard normal. 

(b2) Assume that 

P{|log(l - 1^)1 > x} ~ e{x), x-^oo, (6) 
for some i slowly varying at oo, and that 

lim P{| log(l - W)\ > x}{t{x)f = oo. 

Then, with a„ := /u~^/^c(log n)-0(n), the limiting distribution of is standard normal. 

(c) Assume that 

W{\logW\>x} ~ x^oo, (7) 

for some I slowly varying at oo and a G (1)2). Let c{x) be any positive function satisfying 
lim x£{c{x)) / c" (x) = 1 which implies that c{x) ~ x^^"i*{x), x — t- oo, for some i* slowly 
varying at oo. 
(cl) // 

lim P{| log(l -W)\> x}x2/"-i(r (x))2 = 0, (8) 

then, with a„ = ^he limiting distribution of is standard normal. 

(c2) Assume that 

P{|log(l- W)| >x} ~ x-^^(x), x^oo, (9) 

for some (3 G [0,2/ a — 1] and some i slowly varying at oo. In the case (3 = 2/a — 1 assume 
additionally that 

lim P{| log(l -W)> x|}x2/°"^(r(x))2 = oo. 
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Then 

v-^dZ{v), 



H 1 VQc(logn)V'(n) 7[o,i 
where (■Z^('y))^g[o,i] is an a-stable Levy process such that Z{1) has characteristic function 

n i-> exp{-|'u|°T(l - a)(cos(7ra/2) + isin(7ra/2)sgn(n))}, ueR. (10) 

Throughout one can take b'^ := J^^ logn] ^'^si^ ~ ^)l > a:}dx in place of bn- 

Remark 1.3. The integrals Jjq ^ v~^dZ{v) appearing in the theorem and also in formulae p4p 
and (j35|) are understood to be equal to Z{1) in the case /3 = and to be defined by integration 
by parts formula 

/ v-^dZ{v) = Z{1) +(3 [ v-'^-^Z{v)dv 
J [0,1] J [0,1] 

in the case f3 £ (0, 1/a) (when referring to formula (j34p we take a = 2). Note that the latter is 
consistent with the standard definition of stochastic integrals (with respect to semimartingales) . 
It is known that 

logEexpfit/ v~^dZ{v)] = logEexp (it?;-'^Z(l))d?;, t G R, 
V J[o,i] J ^[0,1] 

from which it follows that the integral is indeed well-defined only if /3 G [0, 1/a) and that 

y-l^dZiv) = (1 -a/3)-i/"Z(l). 

[0,1] 

Remark 1.4. Theorem 11.21 does not cover two interesting cases. Assume that the standing 

assumptions of the theorem hold. 

Case (b3): Condition dH holds, = oo, and 

P{|log(l-T^)|>x} ~ J^^, ^^oo, 

for some d > and i* (x) defined in part (b) of the theorem. 
Case (c3): Condition ([7]) holds, and 



P{|log(l-H^)|>x} ~ j^^, x^oo, 

for some d > and i* (x) defined in part (c) of the theorem. 

Some partial results and discussion of the problems which arise in these cases can be found 
in Remark 13.71 

Remark 1.5. We conjecture that under the assumption /i < oo the conditions given in Theo- 
rem [T?2] and Remark 11.41 are necessary and sufficient for the weak convergence of L„, properly 
normalized and centered. 

The rest of the paper is structured as follows. In Section [2] we point out the set of conditions 
under which the number of zero decrements of a nonincreasing Markov chain weakly converges 
to a geometric law (Theorem 12. ip . Theorem 11.11 then follows as a particular case. Section [3] is 
devoted to proving Theorem 11.21 Some results derived in Section [3] can be used to answer a 
question asked in |19] . A detailed discussion of this is given in Section [H Some auxiliary facts 
are collected in the Appendix. 
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2 Number of zero decrements of nonincreasing Markov chains 

2.1 Definitions 

With M G No given and any n > M, n G N, let / := {^kin)) ^^^^^ be a nonincreasing Markov 
chain with Io{n) = n, state space N and transition probabihties 

P{/fc(n) = j\Ik-i{n) = i} = TTjj, i> M + 1 and either M < j < i or M = j < i, 
F{Ik{n) = j\Ik-i{n) = i} = 0, i<j, 
F{Ik{n) = M\Ik-i{n) = M} = 1. 

Denote by 

Zn := #{k G No : - = 0, /fc(n) > M} 

the number of zero decrements of the Markov chain before the absorption. Assuming that, for 
every M + 1 < i < n, Hi^i-x > 0, the absorption at state M is certain, and Z„ is a.s. finite. 

Neglecting zero decrements of / along with renumbering of indices lead to a decreasing 
Markov chain J := {Jki''^)) j^^^^ with jQ{n) = n and transition probabilities 

^ij = -I ^''^ , i> j>M 

(the other probabilities are the same as for /). The chain J visits a given state k and the chain 
/ visits the state k for the first time with the same probability 

9n,k ■■= Yl ^Um{n) = k}, k<n,ken. 

m>0 

Note that gn^n = 1 and that g^^k is the potential function of J. 

Let {Rj)M+i<j<n be independent random variables such that Rj = geom(l — vTjj). Assuming 
the -Rj's independent of the sequence of states visited by J we may identify Rj with the time / 
spends in the state j provided this state is visited. With this at hand Zn can be conveniently 
represented as 

= 5Z^A-(n)l{A-(n)>M}- (11) 
fc>0 

2.2 Main result of the section 

Theorem 12.11 given below proves that the number of zero decrements of a nonincreasing Markov 
chain weakly converges to a geometric law whenever the probability of delay at the present state 
and that of transition to the absorption state are asymptotically balanced, and the Markov chain 
has no 'stationary' version. An interesting feature of this quite general result is that its proof 
needs nothing beyond simple distributional recurrence (|16p . 

Theorem 2.1. Assume that lim gn k = ^ for each A: G N, lim vr^ „ = and 

n— >oo ' n— >oo ' 

lim = cG (0,oo). (12) 

Then 

Zn — >• Z = geom((c + 1)^^), n — )■ oo. 
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Theorem 12.11 will be proved by the method of moments. To this end, we have to possess 
some information about the moments of integer orders of the limiting geometric law. The explicit 
expressions are complicated and actually not needed. The moments satisfy a simple recurrence 
which is sufficient for our needs. 

Lemma 2.2. Let X = geom(a), a > 0. The moments := KX^ , A; G N can be recursively 
obtained via ^ 

mi = b, nij = bll + ^r.]miY j = 2,3, (13) 



i=l 



where 6 := (1 — a) /a. 

Proof. Let (C^OfceN be independent Bernoulli random variables with success probability a. Then 
X ^ mf{k G N : a = 1} - 1 = l{a=o}(l + (mf{A: G N\{1} : Cfc = 1} - 1)) =: l{c,=o}(l + ^'), 

where X' is independent of Ci and X' = X. The latter implies 

EX^ = (1 - a)E(l + Xy, j G N, 
and representation (fT3|) follows. □ 



Now we are ready to prove Theorem [2Tj For notational convenience we assume that M = 0. 
For other M's the argument is the same. 

Let Vn denote the size of the last decrement. Then 

F{Vn = k} = gn.fcTTfc.o = gn,fc , , A; = 1, 2, . . . , n, (14) 

1 - TTfc^fc 

and 

lim P{K = k} = 0, for each A; G N. (15) 

n— >oo 

Since the geometric law is uniquely determined by its moments, it suffices to prove that, for 
each i G N, lim E.^^ = EZ*. To this end, we will use the induction on i and start with the case 

n— ^oo 

1 = 1. Using representation (jlip and conditioning on the first decrement of J we deduce the 
distributional equality 

Zn = ^J(n) + Rn-, (16) 

where, for each A; G N, is independent of both J{n) := Ji{n) and and has the same law 
as Zf^. Equality (fTUj) (or just ([TT]) ) implies that 

n n 

k=l k=l 

Recalling (jl5p and (|12p and applying Lemma fS.ll to the last sum lead to the conclusion lim EZ„ = 
c = EZ. 

Assume now that lim EZ* = EZ* for alH < j — 1, i G N. We have to prove that lim EZn = 

n— >oo n— ^-oo 

KZ^ . In view of Lemma [22] it suffices to check that lim EZn = ruj, where ruj satisfies (11311 with 
b = c and = EZ*. Using ([T6|) yields 
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or, equivalent ly, 



n n -. 

w.zi = y2gn,kbk = Vp{K = k} """''S fc. 



In view of Lemma 15.11 to finish the proof it remains to show that 

i-i 



hm - — ^^^bn = c( 1 + ( ) 



or equivalently that, for i < j — 1, 

n^oo 7r„^o n-5>oo 7r„^o 

Applying Lemma 12.21 with a = 1 — TTn^n to the RnS we conclude that 
Further, one can easily check that lim 6„ = 0, hence 

n— >oo 

lim EZ\(. = EZ\ i<j-l. 
These two observations immediately establish (jl7p . The proof is complete. 



2.3 Proof of Theorem [TTTl 

In this subsection we prove Theorem 11.11 by an application of Theorem 12.11 To distinguish 
general (nonincreasing) Markov chains in the previous subsections from the particular Markov 
chain discussed below we mark all the quantities which correspond to the latter with asterisk, 
for instance, /-;>/*, gn,k 9n^k 

Now we present one more construction of the Bernoulli sieve which highlights the connection 
with nonincreasing Markov chains. The Bernoulli sieve can be realized as a random occupancy 
scheme in which n 'balls' are allocated over an infinite array of 'boxes' indexed 1,2,... according 
to the following rule. At the first round each of n balls is dropped in box 1 with probability 
Wi. At the second round each of the remaining balls is dropped in box 2 with probability 
W2, and so on. The procedure proceeds until all n balls get allocated. Let Il^{n) denote the 
number of remaining balls (out of n) after the kih. round. Then /* := {Il{n))keNo is a pattern 
of nonincreasing Markov chains described in Subsection 12.11 with M = and 

^EW^l-Wy-^, j<i. (18) 

It is plain that L„ is the number of zero decrements of /* before the absorption. 

The assumption ^ = 00 implies that lim g* i, = 0, for each /c G N. In the case that the law 

n— >oo ' 

of I logH^I is nonlattice this fact was pointed out in formula (16) in [13]. The complementary 
case does not require any new proof once one has noticed that the overshoot at point x of a 
standard random walk diverges to +00 in probability (as x — 00) under the sole assumption 
that the step of the random walk has infinite mean. In view of (jlSp vr* „ = EVK" — t- 0, as n — )■ 00 
(recall that the law of W has no atom at 1), and condition (jl2p reduces to ([T]). According to 
Theorem 12.11 relation ([2]) holds. 
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Condition is equivalent to 

F{\logW\<x} 
™ P{|log(l-Ty)| <x} ~ 

Applying Lemma [512] with ^ = | log VF| and r] = \ log(l — W)\ establishes implication ([3]) =^ ([1]), 
thereby completing the proof of Theorem 11.11 

3 Proof of Theorem D 

In the first (main) part of the proof we work with a poissonized version of the Bernoulli sieve. 
Specifically we assume that the balls are thrown at arrival times (r„)„gN of a unit rate Poisson 
process {'n't)t>o- The quantity in focus is then L(t) := L^^, where (vTi) is independent of {Lj). 
At the last step of the proof we return to the original, fixed n problem (this step is called 
depoissonization) and prove the implication 

L{t)-b{t) d ^ , Ln-b{n) d „ 

, , X, t^oo^ , , ^ X, n oo. 

a{t) a{n) 

Set 

5fc := - logTfc = I log l^il + . . . + I log Wk\ and Sk := Sq + Sk, ke No, 
where 5*0 is a random variable which is independent of (Sk) and has distribution 

F{So<x} = fi~^ F{\logW\> y}dy, x>0. 

J[0,x] 

Define 

N{x) := mf{k G No : 5^ > x} = #{k G No : S'fc < x} and iV(x) := #{n G No : 5„ < x}, x > 0, 

and recall that {N{x))x>o and {N{x))x>o are non-stationary and stationary renewal processes, 
respectively. For later use, we recall (see p. 55 in [15j for the proof) that A^(x) enjoys the 
following (distributional) subadditivity property 

d 

N{x + y) - N{x) < N{y), x,y>0. (19) 
In the sequel we work with the following random variables 

C{t):=Y,^{t-Sk)l{S,<t}= f (^(t-x)diV(x), t>0 



A:>0 

and 



dit) ■.= Y,^it-Sk)l{s,<t}= [ ^it-x)dN{x), t>0, 

where ip{t) := V'(e*), t e R, V(t) := Ee-*^^-^), t > 0. 

We show in Lemma |3. II that convergence in distribution of L{t) is completely determined by 
convergence in distribution of 

L*it) := ^exp(-te-^'=-i(l - W^fc))l{S,_,<iogt}- 

k>l 
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The Bernoulli sieve is governed by two sources of randomness: randomness of the 'environment' 
{Wk) and sampling variability (i.e. the variability of the occupancy scheme with deterministic 
frequencies obtained by conditioning on (W^)). Since L*{t) is a function of the environment 
alone we conclude that the weak convergence of L{t) {Ln) is completely determined by the 
randomness of the environment, whereas the influence of the sampling variability is negligible. 

In its turn convergence in distribution of L*{t) is determined either by that of L* {t) — C {[ogt) 
or that of C(logt), or that of both, and our main task is to find out what is the extent of their 
interplay. In the cases (a), (bl) and (cl) the contribution of L*{t) — C(log t) dominates, whereas 
in the cases (b2) and (c2) it is negligible in comparison with the contribution of C(logt)0 

We divide the proof of the theorem into several steps. 
Step 1. The purpose of this step is proving a central limit theorem for L{t) — C(logt) (Lemma 
13. 3p . To this end we first show that the asymptotic behavior of L{t) coincides with that of L*{t). 

In what follows we write that the family of random variables is tight meaning that the family 
of laws of these random variables is tight. 

Lemma 3.1. Whenever /i < oo and the law of |logW^| is non-lattice, the families [L{t) — 
^*(*))t>i and (C(t) - C(t))^>g are tight. 

Proof. Set M{t) := Mj^^ and K{t) := K-j^^. These are the index of the last occupied box and the 
number of occupied boxes in the poissonized version of the Bernoulli sieve, respectively. Clearly, 
L{t) = M{t)-K{t). 

Fact 1: The family {M{t) - N{\ogt))t>i is tight. 

We use the representation M{t) = A^(| log C/i.ttJ), where Ui^n ■= min Uj. It is well-known 

that I logC/i^nl — logn G, n ^ oo, where G is a random variable with the standard Gumbel 
distribution. Since (vrj) is independent of Ui^n we also have | log f/i^vrj — logTr^ G, t ^ oo. By 

P : : d 

noting that logvr^ — logt — ?■ 0, t — ?■ oo we finally conclude that | log {7i,7rt| — logi — )■ G, t — >• oo. 
Using (fT9]) along with independence of [N{x)) and t/i,7rt we obtain 

M(t)-iV(logt) < (iV(|logC/i,.J)-iV(logt)))l||iog^,^j>i„gi| 

d -s d 

< Af(|log[/i,^J-logt)l|| 

log;7i,^J>logt} ~^ ^(G')l{G>o}, t — 5- oo. 

Similarly 

M{t)-N{logt) > -(iV(logt)-iV(|logC/i,,J))l||logt;,_^j<logi| 
d ^ 

> -A^(logt- |logC/i,^J)l||iogC7i,,j<iogt} ^ -Ni-G)l{G<o}, t^oo. 

Fact 2: The family {K{t) - E{K{t)\{Wk))) is tight. 

This was proved in formula (28) in 
Fact 3: The family 

(lit) - N{\ogt) + 5^ (1 - exp(-te-^'=-i(l - Wk))) 
^ fc>i 

is tight. 

^It seems that there are situations (cases (b3) and (c3) introduced in Remark ll.4[) when contributions of both 
variables are significant, and both of these determine the asymptotics of L{t). See Remark 11.41 and Remark 13.71 
for more details. 
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Since 



k>l k>l 



Fact 1 and Fact 2 together imply the statement. 
Fact 4: The family (Y{t))^^^, where 



Y{t) := E (1 - exp(-te-^'^-Hl - ^fc)))l{s,_i>iogt}, 



k>l 



is tight. 

Since 1 — is monotone and integrable on (— oo,0], it is directly Riemann integrable on 
(—00,0]. Hence, by the key renewal theorem (see Theorem 4.2 in [1]) 

Ey(e*) =ET{l-^{t- Sk))lis,>t} ^ /i^' / (1 - i^{y))y~'dy < oo, 



A;>0 



and Fact 4 follows. 

Now we are ready to prove the lemma. Since 



L{t) - L*{t) = (lit) - N{logt) + E (1 - exp(-te-^'=-Hl - Wk)))) - Y{t), 
^ k>i ' 



the first assertion of the lemma follows from Fact 3 and Fact 4. 
In view of the inequality 



i{>{t-Sk)-v(i-S],)Y(s^<i\ ^ V'(i - 'S'fc)l{5fc<t} - V^(* - 5'fe)l|s^<i| 

ip{t - Sk) - fit - Sk)^ '^{s^<t} 

= fit- Sk)l^s^^^^§^^^^y 

+ '/'(*- 'S'fc)l{i_5„<5^<(_5Q<i} a.s., 
to prove the second assertion it suffices to check the tightness of 

- ( E '^(^ - ^k)'^{S,<t<s,} ) and Ca := ( E ( " ^k) - f{t - Sk) J l^g^^^y ) . 

Using (fT9]) gives 



E9^(i-5fc)V5o<5.<t,5o<*} ^^(0)(^W-^(*-^o))l{5o<t} ^^^^^^ 



fc>0 

It is clear that 



( ^Vii-Sk)l{s,<t})l0^ 

^ k>0 ' 



0, t oo, 
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and the tightness of Ci follows. Using the mean value theorem for differentiable functions and 
the monotonicity of ^' we obtain 



Since 



E - Sk))l0^^^y = I {-ip'{y))dy ^ V(0), t ^ oo, 



the family C2 is tight. The proof is complete. □ 

Further we need a preliminary result which establishes a weak law of large numbers for C{t). 

Lemma 3.2. Suppose /i < 00, v = 00, and the distribution of \ logVFl is non-lattice. Then 

C{t) p _i , 
k{t) 

where ^ 

k{x) := / ip{y)dy, x > 0. 
Jo 

Proof. The assumption = 00 is equivalent to lim k{x) = 00. In view of Chebyshev's inequality 
it is enough to check that 

EC\t) ~ (EC7(t))2 ~ fi-^k\t), t^oo. 
By Lemma 15.4( a). the required asymptotics of EC(t) follows easily. Using the equality 

C{t) = ^{t) + C'{t-Si)^s^<t} a.s., 
where C'{t) := J2k>i ~ + Si)l^Sk-Si<t} = C{t) is independent of 5*1, we have 

EC^{t) = 2 [ ^{t-x)ECit-x)d'EN{x)- [ ip'^{t - x)d'EN{x). (20) 

J[0,t] J[0,t] 

The second term exhibits the following asymptotics 

/ ip'^{t-x)dEN{x) = o{k{t)), t-^00. (21) 

i[0,i] 



To see this, use the key renewal theorem in the case J^q ^^ip'^[x)dx < 00 or Lemma [5l 

followed by I'Hopital rule in the case ^lim J^^ (/?^(x)dx = 00. 

Since both k{t) and (1 — ip{t))k{t) are nondecreasing functions we apply Lemma l5.4l fb) to 
obtain, as i — )■ 00, 

/ ip{t-x)k{t-x)dEN{x) fi-^ ip{x)k{x)dx = {2ny'^k^{t). (22) 

J[0,t] J[0,t] 
Further, for fixed a € (0, t) 

ip{t - x)k{t - x)dEN{x) < k{a) {EN{t) - EN{t - a)) < k{a)EN{a) (23) 

[t-a, t] 
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in view of (I19D. Hence 



(p{t-x)k{t-x)(mN{x) ~ / (p{t-x)k{t-x)<MN{x), t oo. 

[0,t] J[0,t~a\ 

Likewise, since 

sup EC(x) < oo, 

xG[0, a] 

we conclude that 

/ ip{t - x)EC{t - x)dEA^(x) < sup EC{x)EN{a) < oo. (24) 

J[t-a,t] xe[0,a] 

Now we are ready to derive the asymptotics of EC^(t). For any e G (0, there exists xq > 
such that — e < EC{y)/k{y) < fi~^ + e for y > xq. With this xq we have 

ip{t - x)EC{t - x)dEN{x) < ifi'^+e) / ip{t - x)k{t - x)dEN{x) 

[0,t] J[0,t-xo] 



+ [ ip{t- x)EC{t - x)dEN{x) 

J\t-xn.t] 



'[t-xo,t] 

f >^{t-x)k{t-x)dEN{x) + 0{l) 
J[o,t] 

^ {^.-^ + e){2^.)-'k\t). 

Sending and recalhng (|2Up and (|21|) we conclude that 

EC^it) _2 

Arguing similarly we obtain the converse inequality for the lower limit. The proof is complete. 

□ 

Lemma 3.3. Suppose n < oo, u = oo, and the distribution of \ logiyj is non-lattice. Then 

L{t)-C{\ogt) d 



7V(0, 1), t^oo. (25) 



^/x-ifc(logt) 

Proof. By Lemma l3.H it is enough to prove that 

L*{t)-Cilogt) d 
V/i-ifc(logi) ^ 

Set 

y (exp(-te~^-i(l-Ty,)) -V.(te-^»-i))l|g^,^<i„g,^ 

V^/i-i/c(logt) 

and note that E{Xti\{Wk)k<i~\) = 0. By a martingale central limit theorem (Corollary 3.1 in 
[T6|), relation 

L*(n) - C(logn) d «r.r,i\ (^a\ 
A/(U, Ij, n — >• oo, (zDj 



V^/i iA;(logn) 
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which is just (j25p with continuous variable t replaced by integer n, will hold once we can show 
that 

Y^E{Xl,\{Wk)k<^-l) 4 1, n^oo, (27) 



i>l 

and that, for all e > 0, 

H^niH\Xm\>e}\{^k)k<i-l) ^ 

i>l 



Y,nXn^h\X^.\>e}\iWk)k<^-l) 4 0, n ^ OO. (28) 



It suffices to establish ()27p . as, in view of \Xni\ < ^k(logn), (j28p will follow from it. 

We have 

^ L (V'(2e*-^) - ip'^U - x))dN(x) 



C{t) I[o,t] (V'(e*-") - V'(2e*--))diV(x) /[g^,, ^^(^ _ ^)dAr(x) 



By Lemma 13.21 lim C{t)/{fi^^k{t)) = 1 in probability. To complete the proof of (I27p one has 

to check that the second and the third terms converge to zero in probability. For the third this 
follows from (j2ip and Markov's inequality. The function 1 1— )• ip{e^) — il>{2e^) is directly Riemann 
integrable on M since it is nonnegative and integrable, and the function 1 1— >• e~* [tpie^) —ip{2e^)^ is 
nonincreasing (see, for instance, the proof of Corollary 2.17 in [6]). By the key renewal theorem 



E/ (-0(6*-^) - V(2e*-^))d7V(x) < E/ (^(e*"^) - V(2e*-^))d7V(a;) 

J[0,t] J[0,oo) 



J[0,ool 



'[o,oo; 

= fi^^ log 2, t — )• oo, 

which proves the required result for the second term. 

It remains to pass from (j26p to (j25p . We first note that the function A;(logt) is slowly varying 
at oo. This follows from the equality /c(logt) = f^-^ t(j{y)y~^dy and the representation theorem 

for slowly varying functions (Theorem 1.3.1 in [3]). To prove that ^lim ^l"^^-!^ = 1, where [t] 

denotes the integer part of t, use the slow variation of fc(logt) together with the monotonicity 
to conclude 

kjlogt) ^ fc(log(M + l)) . -I , . 
- A;(log[t]) - fc(log[t]) 

Now we intend to prove the tightness of the family (C(t) — C([t])). To this end we use the 
equality 

C{[t])-C{t)= f {^{[t]-x)-^{t-x))dN{x)- [ ip{t-x)dN{x). 
JloM Jim 

By the mean value theorem 

^i[t]-x)-^{t-x) = -^'{e){t-[t])<e%-i,'{e)) 

< e'-^-^P'{[t] - x)) = -^'{[t] - x)e*-W < -^'{[t] - x)e, 
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where 6 is some value from [[t] — x,t — x]. Consequently, 



C{[t])-C{t)<e {-^'{[t]-x))dN{x), 

J\m] 

and the right-hand side is bounded in probability as, by the key renewal theorem, its expectation 
goes to eil^{l)ii~^ (the function t i— )• —ip'{t) is directly Riemann integrable on M"*" since it is 
integrable on and nonnegative, and 1 1— )• e~^{—ip'{t)) = — ^/^'(e*) is a nonincreasing function). 
On the other hand, in view of ([19]) 



C{[t]) - C{t) >- [ fit- x)dN{x) > -{N{t) - N{[t])) > -N{1). 

Jim 

Finally we want to show that the family [L*{t) — L*{[t])^ is tight. By Lemma |3.H it is enough 
to check the tightness of [L{t) — L([t])). Since L{t) — L[[t]) represents the fluctuation of the 
number of empty boxes after throwing vr^ — ttj^] balls, and the latter variable is bounded from 
above by a Poisson variable with mean one, the desired tightness follows. The proof of the 
lemma is complete. □ 

Step 2. The purpose of this step is investigating convergence in distribution of C{t). The cases 
(a), (bl) and (cl) and the cases (b2) and (c2) are treated separately in Lemma 13.41 and Lemma 
13.61 respectively. 

In what follows we use the following notation. If o"^ < oo we denote by Z(-) the Brownian 
motion and set g{t) := y'a^^jJ^H. If condition 1^ holds we denote by Z(-) the Brownian motion 
and let g(t) be any nondecreasing function such that g{t) ~ /i~^/^c(t), t — t- c«. If condition ([7]) 
holds we denote by Z(-) the a-stable Levy process such that Z{1) has characteristic function 
(flOl) . and let g{t) be any nondecreasing function such that g{t) ~ /i~^~^/"c(f), t — )• oo. 

It is well-known that under either of the conditions of the preceding paragraph, i.e. whenever 
the law of | log W\ belongs to the domain of attraction of an a-stable law, a S (1, 2], 

const g[t) 

m D := D[0,l] under the Ji topology. While the one-dimensional convergence is a classical 
result [8j, the functional version is due to Skorohod (Theorem 2.7 in [22]). Since 

sup \S[tu] - S[tu] \ = So, 
u£[0,l] 

the same functional limit theorem as above also holds for S[t.y An appeal to Theorem 13.7.1 in 
|i23j allows us to conclude thalU 

W^.(0:- ^"-';(f"-U m t^oo. (29) 

in D under the Mi-topology. Certainly, ([29]) entails the one-dimensional convergence V7t(l) =^ 
Z{1), t — )• oo. Hence, by Skorohod's representation theorem there exist versions 

Wt{l) = Wt{l) and Z(l) = Z(l) such that 

Wt{l) ^ 2(1), t^oo, 



"^According to Theorem lb in [3], relation (|29p also holds for the non-stationary renewal process {N{t))t>o- 
Since our argument imitates one given in [3], we omit details. 
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almost surely. In particular, for any £ > there exists an a.s. finite T > such that 

\W^{1)\ < \Z{1)\ + e for all v>T. (30) 

For multiple later use let us write the following estimate: for any positive x{t) such that 
lim x{t) = oo and any a > 



/[0,at](^W-/^"'^)d(-<PW) 



xit) 



< op(l) + (|Z(1)| + £) ^to."^] ^^^^ 



(31) 



where op(l) denotes a term that converges to zero in probability, as t — )• oo. This can be proved 
as follows: 



[0, at] 



iN{v)-f^-'v)di-^iv)) 



[0, at] 



W,{l)g{v)di-ipiv)) 



'[0,at] ■J[0,T] 

= : hit) + hit) + hit). 
It is plain that lim h it) = in probability. As to h it) i write 



/ • • • l{T>at} + / • • • l{T<at} + / • • • ^{T<at} 

JlO.at] J\O.T] J[T,at] 



t— s>oo 



\h{t)\ /fo Ti l^''(l)|5(^)d(-'^W) p 

< ^ ' ' — — > 0, t oo. 



xit) 



xit) 



Finally 



\hit)\ ^ J[T,at]l^4l)|g(^)d(-'^W) ^ 

xit) - xit) 



{T<at} < (1^(1)1 +e) . 



Lemma 3.4. Let the assumptions of parts (a) or (hi), or (cl) of Theorem \1.2\ hold. Then 

Cilogt) - fi-^ki\ogt) p 



and 



^A;(logt) 

Lit)- fi-^kjlogt) 
V/x-i/c(logt) 



-^0, t — > oo. 



7V(0, 1), t^oo. 



(32) 



(33) 



Proof. We start by noting that relation ()33p is an immediate consequence of ()32p and Lemma 
By Lemma |3 . 1 1 relation (|32p is equivalent to 



cjt) - ^l-^kit) ^ 



0, t — )• CO. 



15 



To prove it, we represent the latter ratio in a more convenient form 
C{t) - fi-^k{t) _ /[o,t]^(^-^)^^W -^~^^(^) 

d I[o,t] ^(^)d^(^) - /[o,t] 

ip{t){N{t) - fi-H) /[o,t](^(") - 

..rn. ajtMt) , J[o,t](^(^)-M'Md(-9^(^)) 

By LemmaESl lim S^^B = 0. Since, in view of (129]), Wt(l) 4 Z(l), t ^ oo, we have 
t—>-oo yk{t) 

W,ilf-^M 4 0, t^oo. 



Use now inequahty (13ip with a = 1 and x(t) = \/k{t). Since, by Lemma [5.3l hm 

t-^oo \/k(t) 

we conclude that 



/[o,t] ai'^W-'fiiv)) 

jiin-c, uj j^ciiiiiiaiiiiiit 11111 

I— >oo 

L.(iV(^;)-^-Md(-95(t')) p 
-i-^-^ ■ — > 0, t — )• oo. 

The proof of the lemma is complete. □ 
Remark 3.5. Set 



m{x) := / F{\log{l -W)\ > y}dy, x > 0. 

J[0,x] 

Lemma 5.4 in [lOj proves that \m{x) — k{x)\ is a bounded function. This justifies the last sentence 
of Theorem II. 2i Also this implies that the normalization fj,~^k{t) (y^ ij,~^k{log t)) used in 
Lemma [3T2l Lemma [331 and Lemma [3^ can be safely replaced by ^y fi^^m{t) (y^ fi~^m{logt)). 

Lemma 3.6. (I) Assume that cr^ = oo and that 

[ y¥{|logVF| e dy} ~ i{x), x ^ oo, 
Jo 

for some i slowly varying at oo. Let c{x) be any positive function such that lim -^^W^)) = 
Assume further that 

P{|log(l - > x} ~ x-f^iix), x-^oo, 
for some /3 € [0, 1/2) and some i slowly varying at oo. Then 

A / „-.ciZ(,„. «^oo, (34) 

/i •i/^c[t)(p{t) 7(0,1] 

where (■Z^('t^))i.e[o,i] ^/^e Brownian motion. 
(II) Assume that 

P{|logP^|>x} ~ ^""^(x), x^oo 
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for some a € (1,2) and some I slowly varying at oo. Let c(x) be any positive function such that 



lim ^^^^j^^)^ = 1. Assume further that 

F{\log{l -W) > x\} ~ x-l^iix), x^oo, 
for some (3 G [0, 1/a) and some I slowly varying at oo. Then 

4 / v-^dZiv), t^oo, (35) 

fi-^-y-c{tMt) J[o,i] 

where {Z{v))y^[Q^i] is the a-stable Levy process such that Z{1) has characteristic function pO|) . 
Proof. The condition 

P{|log(l -T^)| > x} ~ x-^£{x), x-^oo 
is equivalent to the following 

¥{l-W<x} ~ (log(l/x))"^£(log(l/x)), xiO. 

By Theorem 1.7.1' in the latter is equivalent to 

ip{t) ~ t-^e{t), t^oo. (36) 

Recalling the relation g{t) ~ const c(t), t — )■ oo, we conclude that 

lim g{t)Lp{t) = oo. (37) 

In view of Lemma 13.11 it suffices to prove that 

C {tj:= — — ^ / V '^aZlvj, t — > oo. 

Case 13 = 0. Recalling Wt{l) A Z(l), t ^ oo and using the equality 

C*{t) = Wt{l) + '-^ 

9{tmt) 

we conclude that it remains to check that the second term in the right-hand side converges to 
zero in probability. According to ([3T]) (with a = 1 and x{t) = g(t)ip{t)), it is enough to show 
that 

^^^/,,,,(.)d(-^(.))^^_ (38) 
t-^^ g{tMt) 

In view of Potter's bound (Theorem 1.5.6 in [4J), given A > and 6 £ {0, 1/a — (3) (here we 
take a = 2 in the case (I) of the lemma) there exists to > such that 

^ < Au'/^-', (39) 

whenever t > tQ, tu > tQ and u < 1. Since 

/[to,t]5Wd(-'^(^)) ® J[*o,*]^'^""'d(-¥'(^)) ^ ^ 

— — ^-^ — < ^ — —r, — ? — —^0) t — ^ oo, 

g{t)ip{t) - t^/'-^ip{t) 
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where the last relation is justified by Theorem 1.6.4 in [3], and 

hm — — ■ — -- — = 0, 

t-5-oo g[t)ip[t) 

which holds in view of (j37p . (j38p follows. 

Case /3 / 0. We use the representation: for any fixed e > 0, 



c*(t) = Wt{i)+ / Wt{v)^lt{dv) 

'[0,1] 



= Wt{l) + ...+ 

J[0,e] J [6,1] 

=: Wt{l) + Ii{e,t) + l2{e,t), 

where the measure fit is defined by 1]) = ip{vt) / ip{t) , v G [0, 1). 

According to (p6|) . as t — )• oo, converges weakly on [e, 1] to a measure defined by 
fi{{v, 1]) := . Together with (p9]) this entails the convergence 

by Lemma 15.61 Further one can check that 

Wt{l) + l2{e,t) A Z{l) + I3 [ Z{v)v-'^-^dv, t^oo. 

J[e,l] 

According to Theorem 4.2 in [2], it remains to show that, for any 7 > 0, 

limlimsupP{|/i(e,t)| > 7} = 0. 

In view of inequality (j3ip (with a = e and x{t) = g{t)ip{t)) this will follow once we can prove 
that 

r r Ilo,et]9iv)d{-v{v)) 

hmlimsup — ■ — — = 0. (40 

Since lim -^t^'^ol } j- '^^ _ q ^^gg ([37]) ') and 

where the last relation is justified by Theorem 1.6.4 in [3], (j40p follows. The proof of the lemma 
is finished. □ 

Step 3. The purpose of this intermediate step is to combine results of the two previous steps 
into a single statement concerning convergence in distribution of L{t), properly normalized and 
centered. In particular, we conclude that under the assumptions of the theorem 



L{t) - b{t) 
a{t) 



X, 00, (41) 



for b{t) := ti-^k{logt), case-dependent normalizing function a{t) and case-dependent random 
variable X. Now we identify the functions a{t) and the laws of X for each case. 
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Cases (a), (b1) and (cl): X = 7V(0, 1) and a{t) = ij,-'^k {log t). This immediately follows 
from P5|) . 

Case (b2): X = 7V(0, 1) and a{t) = n-^/'^c{\ogt)ilj{t). By LemmaE3]and Lemma ESI (case 
/3 = 0), 

L{t)-C{\ogt) d , C(logt)-/i-ifc(logt) d _ 

-^====- A/ 0,1 and — — — y A/ 0, 1 , t ^ oo, 

V/z-iA;(logt) /U ^/^c(logt)V'(t) 

According to (I36p . 99(t) ~ t — ?• cxd. Therefore, as t — t- oo, k{t) ~ (use Proposition 
1.5.8 in [4j) and c{t)^p{t) ~ t^/'^t{t)i{t) which, in view of the assumption lim i{t){t {t) f = oo, 

t—^oo 



implies /_im ^j^g^ = 0. Hence, 

L(t)-^-ifc(logt) . ^^^^^^^ 



/i-3/2c(logt)'(/;(f) 

Case (c2): X = /^^ ^ u-^dZ(^;) and a(t) = /i"i"i/°c(logt)V'(t). By LemmaE3]and Lemma 

ESI 

V/x-iA:(logt) ^ ' /i-i-V"c(logt)V^(t) y[o,i] ^ 

respectively. According to ([36]) . ip{t) ~ t~f^£{t), t — )• oo. Therefore, as t — >• oo, A;(t) ~ 
const by Proposition 1.5.8 in [3], and c{t)ip{t) ~ t^/'^^f^ t{t)£{t). While in the case 

/? G [0,2/a — 1) the relation lim e(iog^!)'^(t )' ~ holds trivially, in the case /3 = 2/a — 1 it is 



secured by the assumption lim^(t)(^*(t)) = oo. Hence 



L{t) - /i~iA;(logt) 



/ y-l^dZiv), t-^oo. 
J\o,i] 



/i-i-i/"c(logt)V'(t) y[o,i] 

Step 4. Depoissonization. Since L{Tn) = Ln, where (T„)„gp^ are arrival times of (irt), it suffices 
to check that 

L{Tn) - h{n) d 

-— — A, n — CO. 

a{n) 

In the subsequent computations we will use arbitrary but fixed x G M. Given such an x we will 
choose no S N and to > such that n it x^/n > forn > no and t ± x^ft > for t > to- With 
this notation laid down all the inequalities or equalities that follow will be considered either for 
t > to or n > no. 

The functions a(t) are slowly varying. While in the cases (b2) and (c2) this is trivial, in 
the remaining cases, as has already been mentioned, this follows from the equality A;(logt) = 
/[I t] V'(2/)y~^dy and Theorem 1.3.1 in [4|. The slow variation implies that the convergence 

lim = 1 takes place locally uniformly in y. In particular, 

ait ± x\/t) , , , 

lim — --^ = 1. 42) 

t^oo a(t) 

The function 6(t) enjoys the following property 

lim (6(t ± x^^t) - hit)) = 
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which entails 

hmMi±4^ = 0. (43) 
t^oc a{t) 

Indeed, 

< b{t + xVi) - b{t) = fi-^ V(y)dy < log(l + xt"^/^) ~ 

J[t,t+Xy^ 

and the corresponding relation with 'minus' sign follows similarly. 
Now (j42p and (j43p ensure that ()4ip is equivalent to 

L{t ± xy/t) - b{t) d 



a{t) 

We will need the following observation 

M{t + xVi) - M{t- xVi) p 



X, t^oo. (44) 



0, t^oo, (45) 



a{t) 

where the notation M{t) = M^^^ has to be recalled. Actually, we can prove a stronger assertion 

M{t + xVt) - M{t - xVt) 4 0, oo, 

as follows. Since M{t) is nondecreasing it suffices to show that the expectation of the left-hand 
side converges to zero. To this end, we first prove the formula 

EM(t) = (1 - exp(-te-^'=)) = E / (l - exp(-te-^))dA^(y). (46) 

fc>0 ^[0,oo) 

We use a variant of the random occupancy scheme with the random frequencies P^'s defined in 
the Introduction in which balls are thrown at the arrival times of the Poisson process (ttj). It is 
clear that M{t) = on the event {irt = 0} and that 

M{t) = mi{k G N : ^fc+i,t + ^fc+2,t + ■ • ■ = 0} 

on the event {nt > 1}, where iTk^t is the number of balls (out of nt) falling in the kth box. Given 
(Pfc) {TTj,t)t>o is a Poisson process with intensity Pj, and, for different j, these Poisson processes 
are independent. With this at hand, it remains to write 



E{M{t)\{Pj)) = 5^P{M(t) > k\{Pj)} = 1 - e-* + J2n^k+i,t + vrfc+2,t + • • • > l\{Pj)} 

k>0 k>l 

= 1 - e-* + ^ (1 - exp(-t(l - Pi - ... - Pfc))) 

k>l 

= ^(l-exp(-te-^'=)), 



k>0 

and (06]) follows on passing to the expectation. Using ([I6|) we have 



:(^M{t + xVt) - M{t - xVt)^ 

\ I I exp iy — {t — xVi)e~^) — exp {-{t + xVi)e-y) )dN{y) 

J[0,oo) V / 

< ^^^E / exp ( - (t - xVi)e-y) {t - xVi)e-ydN{y) 

t-X\/t J[0,oo) 



E( 

E 



'[0,oo) 
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where the last relation follows by the key renewal theorem (the function t i— )• exp (t — e*) is 
directly Riemann integrable on M since it is integrable on M and nonnegative, and 1 1— )• exp(— e*) 
is a nonincreasing function). 

Further, setting An{x) := {Ir^ — n| > x-^/n} and recalling the notation K{t) := Kt^^, we have, 
for any e > 0, 

L(t„) - L(n - x^) ^ ^ ^ ^( M{Tn) - K{Tn) - L{n - x^) ^ 



a{n) j [ a(n) 



^ p M[n + Xy/n) — K{n — Xy/n) — L{n — Xy/n) 
~ a(n) 



Hence 



+ IP{---1a„(x-)>4 

( M(n + xJn) - M(n- xJn) ] , . , 

limsuppl '^*"""^"^'"'''^* > 24 < ¥{\M{0,1)\ > x}, (47) 

n— >oo [ a[n) J 

by (1451) and the central limit theorem. Since the law of X is continuous, we conclude that, for 
any y G M and any e > 0, 

limsupP<^ ^ \ , ' >y} < limsupP<^ -^^^^^ j- > 2e 

a{n) J „->oo [ a{n) 



n—>oo 



Tvr. i L(n — Xy/n) — b(n) 

+ hm P<^ — ^ — >y-2s 

n-^co [ a[n) 

Bit.lliTt 

< P{|AA(0,1)| > x} +P{X > y-2e}. 



Letting now x — )• 00 and then e \,0 gives 

limsupp|^^^H=^ > yl < ¥{X > y). 
n^oo [ a{n) J 

Arguing similarly we infer 

hmsuppj^^^^^i^^^^^— ^ >24 <F{|Ar(0,l)| >x} (48) 
n-s>oo [ a[n) J 



and then 



. ^ , L(Tr,) — b(n) 1 , ^( L(n + xJn) — b(n) 

liminfP<^ ^ "^^ ^ ^ ^ >y} > lim P<^ — ^ ^ > y + 2e 

" a(n) J ra-s>oo [ a(n) 

- limsupP< ^ ^ — > 2e 

a(n) 



n— >oo 



Hili.ilist 

> P{X > y + 2e} -P{|AA(0,1)| > x}. 



Letting x — t- 00 and then e J, we arrive at 

liminfp|:^M:i^ > yl > F\X > y]. 
n^oo [ a(n) J ^ ^ 

The proof of Theorem 11.21 is complete. 
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Remark 3.7. Here we discuss what is known in cases (b3) and (c3) introduced in Remark 11.41 
Case (b3): By Lemma 13.31 and Lemma 13.61 



L(t)-C(logt) d ^ , C(logt)-/i-^fc(logf) , 

— =^ — ^ Ai and TTTT-, ^ — r-. — — ^ -^2: t — >• oo, 49 

respectively, where Xi and X2 are random variables with the standard normal distribution. 
According to ([36]), ^(t) ~ d{£* {t))-"^ , t 00. Therefore, as t 00, /c(t) ~ dt{t{t))-'^ (use 
Proposition 1.5.8 in [3]) and c{t)ip{t) ~ Consequently, (09]) is equivalent to 

^:^(L(t)-C(logt)) A {d/i^f'^X, and (C(log i)-/.-^A:(log t)) ^ d^l~^l'X,, t- 

log ' t log ' t 

However, we do not know whether the joint convergence of these ratios takes place, nor do we 
know how dependent the random variables Xi and X2 are. The same remark concerns formula 
(jSTj) given below. 

Case (c3): By Lemma 13.31 and Lemma 13.61 

m^£m X, a„d gO°«') ->'-'K'°<S') 4 X,, *^oo. (50) 

respectively, where Xi = AA(0, 1) and X2 = /jq ^ u "'^^^/"dZ(t;). According to (p6|) . (^(t) ~ 

dti-2/"(r(t))-2, f ^ 00. Therefore, as t ^ 00, k{t) ~ d(2 - 2/aY^t^~'^/'^{t{t))-'^ by Proposi- 
tion 1.5.8 in [4J, and c{t)(p{t) ~ (iti~i/°(r (t))"^ Consequently, ([50]) is equivalent to 

^^(L(t)-C(logt)) A (2^(l-l/a)/d)-i/2xi, ill^(C(logt)-M-iA:(logt)) 4 d^-i-^/^Xa. 

(51) 

It seems that in order to settle the weak convergence issue in these cases one has to investigate 
the weak convergence of L*{t) = X]fc>i exp(— te~'^'=-i (1 — Wk))'\~{Sk-^<\ogt} directly, i.e. without 
using the decomposition L*{t) = [L*{t) - C(logt)) + C(logt). 

4 Answering a question asked in fl9] 

Let (^fc)%)^gi^ be independent copies of a random vector (C,r?) with ^ > and ?] > a.s. 
An arbitrary dependence between ^ and r/ is allowed. In what follows we also assume that 
m := E,^ < cxD, E?7 = 00, and that the law of ^ is non-lattice. Set 

k>l 

where 

Assuming that ^ and rj are independent and that G{x) := Pjr/ > x} is regularly varying at 00 
with index — /3, /3 G [0, 1), Proposition 3.2 in |19] proved that 

V{t)-Y.k> iG{t-S,.{)l~ , 

^ A/ (0,1), t 00. (52) 



00. 



Actually the cited result treats the finite-dimensional convergence. 
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In Problem 1 of Section 5.2 in [19| the authors ask "when can the random centering be replaced 
by a non-random centering?" Relying on the results developed in Section [3] we can answer this 
question in an extended setting where ^ and rj are not necessarily independent. In particular, 
the replacement is possible, i.e., 

V{t)- :.-^J G{y)dy , 

^ _ — 7V(0, 1), t^oo, 

'°~V[o,t] G{y)dy 
if either of the following three conditions holds: 

• ^ oo 

• E^^ = oo, JjQ y^IP{^ G dy} ~ x — t- oo, where £ is slowly varying at oo, and 

lim G{x)c'^{x)x~^ = 0, where c{x) is any positive function which satisfies lim ^^(^j-^^') = i 

x—^oo x—>-oo 

• > x} ~ x^"i{x), X — )• OO for some a G (1,2) and some I slowly varying at oo and 
lim G{x)c'^{x)x^^ = 0, where c{x) is any positive function which satisfies lim ^^^^j^^P = 1 

The replacement is not possible if either of the following two conditions holds: 

• E^^ = oo, /jQ y^P{C G dy} ~ i{x), x — )• oo, where i is slowly varying at oo; G{x) ~ i{x), 



positive function which satisfies lim — \}- J' = 1 



oo, where I is slowly varying at oo, and lim G{x)c^{x)x = oo, where c{x) is any 

xl(c(x)) 



> x} ~ X "£(x), X — )• OO, for some a G (1,2) and some i slowly varying at oo; 
G{x) ~ x~'^^(x), X — )• oo, for some /3 G [0, 2/a — 1] and some £ slowly varying at oo; 



xi{c{x)) 



lim G(x)c (x)x = oo if /3 = 2/a — 1, where c(x) is any positive function which satisfies 



lim = 1 

In these cases 

^(^)-°'"V[o..] G{y)dy , 
m-i-V»c(t)G(t) ^ ^' 

where in the first case a = 2 and X = A/'(0, 1), and in the second case X = Jj^ v~^dZ{v), 
where {Z{v))„^\^q i^ is an a-stable Levy process with characteristic function pO|) . 

To justify these statements we first note that mimicking the proof of Lemma 13.31 we can 
check that relation (j52p holds under the standing assumptions of this section. Let ii^ be a 
random variable with the standard exponential distribution which is independent of everything 
else. We claim that 

- f iV(log x)e-Mx < R{t) := V {G{t - Sk) - ^{t - Sk)) Ir^.^t} < f log x\)e-^dx, 

(53) 

where 

N{t) := mf{k G Nq : Sk > t} and ^(t) := Eexp(-e*-''), t > 0. 
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Using the subadditivity of t — t- t"*", i G IR and the distributional subadditivity of N{t) (see ([19 
we obtain 

{l{r,>t-y}-hlogE+r,>t-y})dN{y) = N {{t - 7] - log E) + ) - N {{t - 7]) + ) 

[o,t] 

< N{{t-ri)+ + {log E)-)-N{{t- 7])+) 

d 



< N{{logE)-). 



Hence 



Rit) = K^,E {'^{r,>t~y} -'^ {log E+r,>t-y})dN{y) 

J[0,t] 

< Er,,EN{{logE)-)= [ 7V(|logx|)e-"dx. 

^fo.il 



The lower bound in (j53p can be proved similarly. 

With (j53p at hand, we conclude that Lemma 13.41 and Lemma 13.61 are still valid if (p(t) is 
replaced by G{t) and C{t) is replaced by J2k>i^i^ ~ ^^~'^^^{Sk i<t}' remains to combine 
these generalizations of Lemma 13.41 and Lemma 13.61 and our extended version of (j52p . 

5 Appendix 

Lemma |5 . 1 1 which is our main technical tool for proving Theorem 12.11 is a rather particular case 
of a Toeplitz- Schur theorem (see Lemma 8.1 in [12]). On the other hand, this result follows 
immediately by an application of the Lebesgue bounded convergence theorem. 

Lemma 5.1. Let (sn)neN be a sequence of real numbers such that lim s„ = s G (0,oo) and 
(cn m)neN msN array of nonnegative numbers which satisfy (A) lim Cn m = 0, for each m G N, 

and (B) Ylm=l ^ri^m = 1- Then lim Ylm=l Cn,mSm = s. 

Lemma 5.2. Let ^ and t] be positive random variables. The relation 

xio F{r]<x} ^ ^ 

entails 

lim = c. 

y^oo Ee~y'^ 

Proof. By symmetry, it suffices to consider the case c G [0, oo). For any e > there exists xq > 
such that < x} /¥{r] < x} < c + e for all x G (0, xq]. With this xq we have 

Ee^y^ lo' e-y'FiC < x}dx + e'^^Fi^ < x}dx 

Ee-y^ ~ e-f^P{ry < x}dx 

(c + e) Jq" e-y'^Fi?] < x}dx + y-^e-y^° 
~ Jq" e-y'Fir] < x}dx 

y-^e-y^'o 

- ^""^^'^ Q^e-y-F{7]<x}dx 

- < xo/2}(e2/^o/2 - 1) ■ 
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Sending y — t- oo and then e — t- proves 

limsup— < c. 

The lower hmit (when c > 0) can be treated similarly. □ 

Before stating the next result we recall notation: Lp{t) = Eexp(— e*(l— H^)), k{t) = J^^ ip{y)dy. 
The functions g{t) were defined in the paragraph preceding Lemma [ 



Lemma 5.3. Assume that u = oo and that either conditions @ and ^ or ^ and ([8]) hold, 
or (T^ < oo. Then 

= ™. l,m /M^faWj^fa" = 0. (54) 

^/k(Fj ^/k(t) 

Proof. Case a"^ < oo. The first relation in ()54p is immediate: 
g'^(tW(t) tif'^it) 

^ ^ ^ = const , // < const ip(t) 0, t ^ oo. 

k{t) k{t) 

Condition = c« is equivalent to lira k{t) = oo. Therefore if the integral J^^ ^■^y^^'^d{—ip{y)) 



converges the second relation in holds trivially. Assume that ^lim Jj^ y^''^d{—ip{y)) = oo 



Integrating by parts, we have 
1 



t—>oo 



y'/'d{-^{y)) ~ -4= / 'P{y)y-'^'dy, t 
2 J kit) J\o,t\ 



y^W) Ao,t] 2^/k(T} J[o,t] 

By I'Hopital rule, 



oo. 



oo, 



which proves the second relation in ([5l 
Case when conditions (|4]) and ([5]) hold. Let r/ be a random variable with distribution such 
that 

1 

(r(-logx))^ 

Then ([5]) is equivalent to 

Wl-W < x} 
lim =— !- = 0. 

a;4,0 P{7/ < x} 

By Lemma 15.21 

lim #1 = 0^ 

Since, by Theorem 1.7.1' in [4J, Ee~*^ ~ (^*(logt))~^, t — )• oo, we conclude that 



Hence 



iim^m*it)y = o. 



g^{t)^Ht) t{t{t)f^'^{t) , 

^ ^ ^ ^ ~ const ^ ^ /; ^ ^ ' < const ip{t){t{t)f ^0, t ^ oo. 



k{t) k{t) 
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If the integral J^^ g{y)d{—(p{y)) converges the second relation in (|54p holds trivially. As- 
sume that ^lim J^Q^^g(y)d{—<p{y)) = oo. According to Theorem 1.8.3 in [4J, we can assume, 

without loss of generality, that g is differentiable. Then, g'{t) ~ const t — )• oo. Inte- 

grating by parts, we have 



1 



5(y)d(-v?(y)) ~ ^— - / ip{y)g'{y)dy, t ^ oo. 



\/W) Ao,t] \fW) h^A 

By I'Hopital rule, 

1 (' , ^ U ^^ n /777T . 9{t) 



y/W) J[i,t] 



^iy)g'{y)dy ~ 2g'{t)^/kit} ~ const t ^ oo. (55) 



t 



If (p{t) ~ (^(^))~^ t oo then, by Proposition 1.5.8 in [4], lim ^^^^v^W ^ i Therefore, the 



t—^oo 



right-hand side of (j55p goes to zero, as t — t- oo, if condition ^ holds. 

The case when conditions ([7]) and ([SD hold can be treated similarly, and we omit details. □ 

Let {SDkeNo be a zero-delayed random walk with positive steps. Set 

N*{x) := mf{k G No : > j;}, x > 0. 
Lemma 15.41 is used in Section [3] for investigating the asymptotics of moments. 

Lemma 5.4. Suppose ES"^ < oo, and the law of is non-lattice, 
(a) Let r : [0,oo) — )• [0,oo) be a nonincreasing function such that 



lim / r{y)dy = oo. 



Then 

E 



[ r{t-z)dN*{z) ~ {ESiy^ [ r{z)dz, t ^ oo. 



'[o,t] J[0,t] 
(b) Let ri,r2 : [0, oo) — ?■ [0, oo) be nondecreasing functions such that ri{t) > r2{t), t>0, and 



lim 



f {ri{y) - r2{y))dy = oo and lim- p^^l-tlii^L^ = o. (56) 

^[0, t] J[o, t] [n (y) - r2 {y)}dy 



Then 

e[ {ri{t-z)-r2{t-z))dN*{z) (ESl)-^ [ {ri{z) - r2{z))dz, t ^ oo. 

JlO,t] J[0,t] 

Remark 5.5. The conclusion of Lemma [5.4f b) is in force whenever ri is a nondecreasing function 
of subexponential growth satisfying Jj^ ri(y)dy = oo and r2 = 0. 

Let us further note that the second condition in ([56|) cannot be omitted. Indeed, assum- 
ing that ri{t) = e* and r2 = we infer E Jjq ri{t — y)dN*{y) ~ (1 — Ee~'^i)~^e*, whereas 

(E5I)-V[o,t]^i(y)d2/~(IESi*)-V. 

Part (a) of Lemma 15.41 is a fragment of Theorem 4 in ^21j. The proof of part (b) requires 
only minor modifications and is thus omitted. 
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Lemma 5.6. Let < a < b < oo. Assume that Xf{-) =^ X{'), as t ^ oo, in D[a,b] in the 
Ml topology. Assume also that, as t ^ oo, fit converges weakly to jj, on [a,b], where (^uj) is a 
family of Radon measures, and the limiting measure fi is absolutely continuous with respect to 
the Lebesgue measure. Then 

[ Xt{-)fit(.dy) A [ X(-)/i(dy), t ^ oo. 

J[a,b] J[a,b] 

Proof. It suffices to prove that 

lim / ht{y)tit{dy) = / /i(y)/i(dy), (57) 

*^°°J[a,b] J[a,b] 

whenever lim ht{y) = h{y) in D[a,b] in the Mi topology, for the desired result then follows by 

t— >-oo 

the continuous mapping theorem. 

Since h S D[a, b] the set Dh of its discontinuities is at most countable. By Lemma 12.5.1 in [23] . 
convergence in the Mi topology implies local uniform convergence at all continuity points of the 
limit. Hence E := {x : there exists Xt such that lim xt = a;,but lim ht{xt) ^ h{x)} C Dh, and 

we conclude that fJ-{E) = 0. Now (I57p follows from Lemma 2.1 in [5]. □ 
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